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BACKGROUND 

1. FIELD 

The present invention relates generally to decoding of variable-length 
codes, e.g., Huffman codes, and, more specifically, to a new decoding scheme 
based on multiple interconnected lookup tables. 

2. DESCRIPTION 

Entropy coding Is a widely used data compression technique that many 
video and audio coding standards are based on. The theoretical basis of 
entropy coding states that a compression effect can be reached when the most 
frequently used data are coded with a fewer number of bits than the number of 
bits denoting the less frequently appearing data. This approach results in coded 
data streams composed of codes having different lengths. 

There are a number of methods to form such variable length codes 
(VLC). One popular method uses a prefixed coding In which a code consists of 
a prefix that allows a decoding system to distinguish between different codes, 
and several significant bits representing a particular value (e.g., Huffman 
coding). 

Another method may use postfix coding schemes where variable length bit 
patterns are appended to the significant bits. 
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As most coding standards employ Huffman codes and provide statically 
pre-coded VLC tables for motion picture coding (e.g., ISO/IEC 11172-2, 
Moving Pictures Experts Group (MPEG)-I coding standard: Video; ISO/IEC 
13818-2. MPEG-2 coding standard: Video; ISO/IEC 14496-2, MPEG-4 coding 
standard: Visual), it is not always true that the most probable data is coded with 
the shortest VLCs. Moreover, the probability distributions for particular video 
streams may have several peaks which means that there may be several code 
groups comprising VLCs of different lengths that are likely to appear In this 
case the variable length decoding methods operating on theoretically predicted 
probability distributions may have lower performance as compared to methods 
that can be adapted to the actual VLC probabilities. 

Therefore, a need exists for the capability to provide high speed 
decoding of variable length codes of different origin, in accordance with the 
actual frequency-to-code length distribution. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The features and advantages of the piresent invention will become 
apparent from the following detailed description of the present invention in 
which: 

Figure 1 is a diagram illustrating an exemplary variable length coding; 

Figure 2 is a diagram illustrating relations between bits read from a bit 
stream, a bit set size, and tables containing decoded values, actual code 
length, references to another tables, and validity indicators; and 

Figure 3 is a flow diagram illustrating the variable length decoding 
process in accordance with an embodiment of the present invention. 



DETAILED DESCRIPTION 
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An embodiment of the present invention Is a method for efficient 
decoding of variable \engVh codes statically defined by a coding standard for a 
wide range of source data. The static definition implies that the source data 
may differ from the data used to compute statistical information for a particular 
standard, thus, the real probability distributions for variable length codes may 
vary from standard-defined values. According to the disclosed method, special 
data structures (or decoding tables) are created. A bit set size is associated 
with each decoding table. Each decoding table element contains a decoded 
value, actual code length, reference to another table (from the set of created 
tables), and a validity indicator for each bit combination that can be formed 
from the number of bits equal to the bit set size. An active decoding table is 
selected. Then the number of bits equal to the bit set size associated with the 
active decoding table is read from a bit stream. The active decoding table is 
indexed with the actual value of bits read to obtain the decoded value, actual 
code length, reference to another table, and validity indicator. The validity 
indicator is then checked to determine whether the decoded value obtained is 
valid. If the decoded value Is indicated to be invalid, the decoding table that is 
referenced by the currentiy active table is selected to become active, and the 
decoding process continues. Otherwise, the bit stream is adjusted in 
accordance with the actual code length obtained and the bit set size associated 
with the decoding tables that were active during the decoding. The decoded 
value is then returned. 

The disclosed method provides for the probability variance by enabling 
fast decoding of a VLC group, which is determined to contain the most 
probable codes. Though the determination is performed by means beyond the 
scope of the present invention, one embodiment may adjust the decoding 
tables and their associated bit set size based on the results of said 
determination. 

Reference in the specification to "one embodiment" or "an embodlmenf 
of the present invention means that a particular feature, structure or 
characteristic described in connection with the embodiment is included in at 
least one embodiment of the present invention. Thus, the appearances of the 
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phrase "in one embodimenf appearing in various places throughout the 
specification are not necessarily all referring to the same embodiment. 

Figure 1 is a diagram illustrating an exemplary variable length coding. As 
depicted by Figure 1, a coding scheme represented by table 10 may be 
comprised of several groups of variable length codes; each group assigned a 
probability value. Unlike other variable length decoding methods that assume 
the shortest codes to be the most probable, embodiments of the present 
invention operate on probability code groups rather than individual codes. This 
allows for a variance between standard-defined probability distributions and the 
actual distributions, as they appear, for example. In natural video streams. One 
embodiment of the present invention may form as many code groups as It may 
be necessary to span all probability distribution peaks in a manner that allows 
codes within a pre-defined neighborhood of a peak probability to comprise one 
group, in the example shown in Figure 1, the coding scheme 10 was divided 
into the following code groups: 1-, 3-, and 4-bit codes 12; 5- and 7-bit codes 14; 
and 8-bit codes 16. 

Figure 2 is a diagram illustrating relations between bits read from a bit 
stream, a bit set size, and tables containing decoded values, actual code 
length, references to another tables, and validity indicators in accordance with 
an embodiment of the present Invention. As depicted in the example of Figure 
2, the first four bits of an example code 20 may be read firom the bit stream in 
accordance with the bit set size associated with the initial decoding table 22. 
The actual value of the bits read may be used as an index to the decoding 
table. In one embodiment, the bit set size associated with a decoding table 
comprises a maximal number of bits used to index the decoding table. As the 
validity indicator obtained from the indexed entry indicates the decoded value 
to be invalid, the latter may be ignored along with the actual code size. The 
reference obtained from the same entry of the decoding table 22 may be used 
to select the next active table 24 for further decoding. The next three bits of the 
example code 20 may be read from the bit stream as the bit set size associated 
with the decoding table 24 equals 3 (in this example). The actual value of the 
bits read may be used as an index to the decoding table 24, where two entries 
describing the same VLC are reserved, because the actual bits read that 
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contain the VLC being decoded may also have trailing bits irrelevant to the 
current variable length code (one inrelevant bit of smaller font size in this 
example). As the validity indicator obtained from the indexed entry indicates the 
decoded value to be valid, the reference to another table may be ignored, and 
the decoded value and actual VLC size may be returned. 

One skilled in the art will recognize various modifications that can be 
made to particular embodiments while staying within the spirit and scope of the 
present invention. For example, the actual code length stored in decoding 
tables may contain an absolute VLC length or a length relative to the bit set 
size of the currently active table. The validity indicator may be combined with 
the reference to another table as the two fields mutually exclude each other. 
And finally, all decoding table elements may be packed Into one machine word 
if their size allows it. 

Figure 3 is a flow diagram illustrating the variable length decoding 
process in accordance with an embodiment of the present invention. 

At block 100, a set of decoding tables may be created. The tables 
should comply with the above described requirements regarding probability 
grouping. Then, at block 102. the Initial table may be selected. The number of 
bits equal to the bit set size associated with the currently selected table may 
be read from the bit stream at block 104. The actual value of the bits read may 
be used to index the currently active table at block 106 In order to obtain a 
decoded value, actual bit length, reference to another table, and validity 
indicator. Then, at block 108, the validity indicator is checked to determine 
whether the decoded value obtained is valid. If the decoded value is indicated 
to be invalid, the decoding table that is referenced by the currently active table 
is selected to become active at block 114, and the control is passed to block 
104. Othenvise, when the decoded value is indicated to be valid, the bit 
stream is adjusted at block 110 in accordance with the actual code length 
obtained and with the bit set size associated with the decoding tables that 
were active during the decoding. I.e., the trailing bits that are not part of the 
decoded VLC are made accessible for future bit stream operations. The 
decoded value is then returned at block 112. 
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For an exemplary embodiment of the present invention implemented In 
the C and Assembler programming languages, refer to Appendix A. This 
example is non-limiting and one skilled in the art may implement the present 
invention in other programming languages without departing from the scope of 
the claimed invention. < 

The techniques described herein are not limited to any particular 
hardware or software configuration; they may find applicability in any computing 
or processing environment. The techniques may be implemented in logic 
embodied in hardware, software, or firmware components, or a combination of 
the above. The techniques may be implemented in programs executing on 
programmable machines such as mobile or stationary computers, personal 
digital assistants, set top boxes, cellular telephones and pagers, and other 
electronic devices, that each include a processor, a storage medium readable 
by the processor (including volatile and non-volatile memory and/or storage 
elements), at least one input device, and one or more output devices. Program 
code is applied to the data entered using the input device to perfomi the 
functions described and to generate output infonmation. The output information 
may be applied to one or more output devices. One of ordinary skill in the art 
may appreciate that the invention can be practiced with various computer 
system configurations, including multiprocessor systems, minicomputers, 
mainframe computers, and the like. The invention can also be practiced in 
distributed computing environments where tasks may be performed by remote 
processing devices that are linked through a communications network. 

Each program may be implemented in a high level procedural or object 
oriented programming language to communicate with a processing system. 
However, programs may be implemented in assembly or machine language, if 
desired. In any case, the language may be compiled or interpreted. 

Program instructions may be used to cause a general-purpose or 
special-purpose processing system that is programmed with the instructions to 
perform the operations described herein. Altematively, the operations may be 
performed by specific hardware componente that contain hardwired logic for 
performing the operations, or by any combination of programmed computer 
components and custom hardware components. The methods described 
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herein may be provided as a computer program product that may include a 
machine readable medium having stored thereon instructions that may be used 
to program a processing system or other electronic device to perform the 
methods. The term "machine readable medium" used herein shall include any 
medium that is capable of storing or encoding a sequence of instructions for 
execution by the machine and that cause the machine to perform any one of 
the methods described herein. The term "machine readable medium" shall 
accordingly include, but not be limited to, solid-state memories, optical and 
magnetic disks, and a carrier wave that encodes a data signal. Furthermore, it 
is common in the art to speak of software, in one form or another (e.g., 
program, procedure, process, application, module, logic, and so on) as taking 
an action or causing a result Such expressions are merely a shorthand way of 
stating the execution of the software by a processing system cause the 
processor to perform an action or produce a result. 

While this invention has been described with reference to illustrative 
embodiments, this description is not intended to be construed in a limiting 
sense. Various modifications of the illustrative embodiments, as well as other 
embodiments of the invention, which are apparent to persons skilled In the art 
to which the invention pertains are deemed to lie within the spirit and scope of 
the invention. 
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APPENDIX A 



© 2002 Intel Corporation 
GetVLC function (Assembler) 
InitTable function ("C") 

Input table ("C") and initial Huffman table (text) 
Bit stream structure ("C") 



Initial Huffman code table 



/* 

Codes Vector differences 



1 


0 


010 


1 


oil 


-1 


0010 


2 


0011 


-2 


00010 


3 


00011 


-3 


0000110 


4 


0000111 


-4 


00001010 


5 


00001011 


-5 


00001000 


6 


00001001 


-6 


00000110 


7 


00000111 


-7 


0000010110 


8 


0000010111 


-8 


0000010100 


9 


0000010101 


-9 


0000010010 


10 


0000010011 


-10 


00000100010 


11 


00000100011 


-1 


00000100000 


12 


000.00100001 


-12 


00000011110 


13 


00000011111 


-13 


00000011100 


14 


00000011101 


-14 


00000011010 


15 


00000011011 


-15 


00000011000 


16 


00000011001 


-16 


00000010110 


17 
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00000010111 
00000010100 
00000010101 
00000010010 
00000010011 
00000010000 
00000010001 

*/ 



-17 
18 

-18 

19 

-19 

20 

-20 



Packed code/value table containing 
information on prefix length and 
significant bit number 



static const long exTable[] = 
{ 

13, /* max bits */ 

3, /* total subtables */ 

5, 5, 3/ ///3, 5, 5, /* subtable sizes */ 

1, /* 1-bit codes */ 
0x00010000, 

0, /* 2-bit codes */ 

2, /* 3-bit codes */ 
0x00020001, 0x0003ffff, 

2, /* 4-bit codes */ 
0x00020002, 0x0003fffe, 

2, /* 5-bit codes */ 
0x00020003, 0x0003fffd, 

0, /* 6-bit codes */ 

2, /* 7-bit codes */ 
0x00060004, 0x0007fffc, 

6, /* 8-bit codes */ 

OxOOOaOOOS, OxOOObfffb, 0x00080006, 0x0009fffa 
0x00060007, 0x0007fff9, 

0, /* 9-bit codes */ 

6, /* 10-bit codes */ 
0x00160008, 0x0017fff8, 0x00140009, 0x0015fff7 
0x0012000a, 0x0013fff6, ' 
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28, /* 11- 
0x0022000b, 
OxOOleOOOd, 
OxOOlaOOOf , 
0x00160011, 
0x00120013, 
OxOOOeOOlS, 
0x000a0017, 



bit codes */ 
0x0023fff5, 
OxOOlffffS, 
OxOOlbf ff 1, 
0x0017ffef , 
OxOOlSffed, 
OxOOOfffeb, 
OxO00bffe9, 



0x0020000c, 
OxOOlcOOOe, 
0x00180010, 
0x00140012, 
0x00100014, 

oxooocooie, 

0x00080018, 



0x0021fff4, 
0x001dfff2, 
0x0019fff0, 
OxOOlSf fee, 
OxOOllffec, 
OxOOOdffea, 
0x0009ffe8, 



12, /* 12-bit codes */ 

0x000e0019, OxOOOfffe?, OxOOOcOOla, OxOOOdf-feS, 

OxOOOaOOlb, OxOOObffeS, OxOOOSOOlc, 0x0009ffe4, 

OxOOOeOOld, 0x0007ffe3, 0x0004001e, 0x0005ffe2, 

4, /* 13-bit codes */ 
OxOOOeOOlf, 0x0007ffel, 0x00040020, OxOOOSffeO, 
-1 /* end of table */ 
}; 



Bit Stream structures 



typedef struct _MplDataBuf 
{ 

unsigned char *data; 



long 
long 
} MplDataBuf; 



data_len; 
data offset; 



typedef struct _MplBitStream 
{ 

bit_ptr; 
*data buff- 



long 
(31-0) 

MplDataBuf 
its size 



unsigned long *start_data; 
pointers 

unsigned long *end_data/ 
unsigned long *current_data; 



FILE 



*fd; 



file 



jmp_buf exit_point; 
handle incorrect vie codes 
} MplBitStream; 



// Buffer bit pointer 



// Pointer to data and 



// Internal bitsream 



// Input or output 



// Exit point to 
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♦define DATA BUFFER SIZE 



1*1024*1024 



unsigned long 
{ 

0x00000000 
0x00000001 
OxOOOOOOlf 
OxOOOOOlff 
OxOOOOlfff 
OxOOOlffff 
OxOOlfffff 
OxOlffffff 
Oxlfffffff 

}; 



bit mask[33] = 



, 0x00000003 

, 0x0000003f 

, 0x000003ff 

, 0x00003fff 

, 0x0003ffff 

, OxOOSfffff 

, 0x03ffffff 

, Ox3fffffff 



0x00000007, 
OxOOOOOOVf , 
0x000007ff , 
0x00007fff , 
0x0007ffff , 
0x007fffff , 
0x07ffffff , 
0x7fffffff , 



OxOOOOOOOf , 
OxOOOOOOf f , 
OxOOOOOfff , 
OxOOOOfff f , 
OxOOOfff ff , 
OxOOffffff , 
OxOfffffff , 
Oxffffffff 



Function to form internal VLC table 



typedef unsigned long VLCDecodeTable; 

static VLCDecodeTable* CreateVLCDecodeTable (const long 
*src_table, VLCDecodeTable *table, long *table_size, long 
cyr_size) 
{ 

long i, k, n, m, p, ncodes; 

long max_bits, vlc_flag; 

long table_of f set; 

long max_tables; 

long tables_bits [ 32 ] ; 

long totalbits, f illed_bits; 

long vm4_vlc_code_mask, vm4_vlc_data_mask, vm4_vlc_shif t; 
max_bits = *src_table++; 

vlc_flag = max_bits & VM4_VLC_LEN_FLAG; 
max_bits = inax_bits & VM4_VLC_LEN; 

max_tables = *src_table++; 
totalbits = 0; 

for(i = 0; i < inax_tables; i++) 
{ 

tables_bits [i] = *src_table++; 
totalbits += tables bits[i]; 

} 

if (totalbits != max_bits) return 0; 

table_offset = (1 « (tables_bits [0] + 1)) + 1; 
assert (table_off set + cyr_size < VLC_STORAGE_SIZE) ; 
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table [0] = tables_bits [0] ; 

switch (vlc_f lag) 
{ 

case VM4_VLC_20: 

vm4_vlc_code_mask = OxfffffOOO; 

vm4_vlc_data_mask = OxOOOOOfff; 

vm4_vlc_shif t = 12; 

break; 
case VM4__VLC_24: 

vm4_vlc_code_mask = OxffffffOO; 

vm4_vlc_data_mask = OxOOOOOOff; 

vm4_vlc_shif t = 8; 

break; 
default: 

vm4_vlc_code_mask = OxffffOOOO; 
vm4_vlc_data_mask = OxOOOOffff; 
vm4_vlc_shif t = 16; 

break; 

} 

for(k =1; k <= tables_bits [0] ; k++) 
{ 

long shift = tables_bits [0] - k; 

long fill_codes = 1 « (shift + 1); 
ncodes = *src_table++; 

for(i =0; i < ncodes; i++) 
{ 

long offset; 
long data, code; 

code = ( ( (*src_table) & vm4_vlc_code_mask) 
» vin4_vlc_shif t) ; 

data = (signed short) ( (*src_table++) & 
vm4_vlc_data_mask) ; 

assert (data != VM4_VLC_F0RBIDDEN) ; 

offset == (code « (shift + 1) ) + 1; 

for(n = 0; n < fill_codes; n += 2) 
{ 

table [offset + n] == k; 

table [offset + n + 1] = data; 

} 

} 

} 

filled_bits = tables_bits [0] ; 
m = 1; 

while (inax__bits > filled_bits) 
{ 

for(k = filled^bits + 1; k <= filled_bits + 
tables_bits [m] ; k++) 
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long shift = filled_bits + tables bits [m] 

- k; " 
ncodes = *src_table++; 

for(i =0; i < ncodes; i++) 
{ 

long offset, idx; 
long data, code; 
long mask, shift_idx; 

code = ( ( (*src_table) & 
vm4_vlc_code_mask) >> vm4_vlc_shif t ) ; 

data = (signed short) ( (*src_table++) & 
vm4_vlc_data_mask) ; 

assert (data != VM4_VLC_F0RBIDDEN) ; 
offset = 0; 
shift_idx = 0; 

for(p = 0; p < m; p++) 
{ 

long sbits, ssize; 
shift_idx += tables_bits [p] ; 
sbits = tables_bits [p+ll ; 
ssize = (1 « (sbits + 1) ) + 1; 
idx = (((code » (k - shift idx)) & 
(d « tables_bits [p] ) - 1))«1) ~ 

+ 1; 



VM4_VLC_F0RB I DDEN ) 



table offset; 



VLC_STORAGE_SIZE) 



} 



if (table [idx+off set] == 
{ 

table [idx + offset] = 0; 

table [idx + offset + l] = 

offset = table_of f set; 

table [table_off set] = sbits; 

table_offset += ssize; 

assert (table_off set + cyr_size < 

} 

else 
{ 



} 



offset = table [idx+off set+1] ; 



mask = (l«(k-shift_idx) )-l; 
code = code & mask; 

, , offset += ( (codes ( (l«tables bits [m] ) - 

1) )«(shift+l) )+l; 
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for(n = 0; n < (1« (tables_bits [m] - 
k+filled_bits+l) ) ; n += 2) 

{ 

assert ( (table [of f set + n] == 
VM4_VLC_FORBIDDEN) && (table [of f set + n + 

1] == VM4_VLC_FORBIDDEN) ) ; 

table [Offset + n] = k - 

f illed_bits; 

table [offset + n + 1] = data; 

} 

} 

} 

filled_bits += tables_bits [m++] ; 

} 

*table_size = table_of f set ; 
assert (*src_table == -1) ; 
return (VLCDecodeTable* ) table; 

} 



Function to decode VLC (Assembier) 



.686 
. xmm 

xmmword textequ <qword> 
mmword textequ <qword> 
.model FLAT 



MplDataBuf 
data dd 
data_len dd 
data_of f set 
MplDataBuf 

MplBitStream 
bit_ptr 

data_buf dd 

start_data 
end_data dd 
current_data 

fd dd 



struc 
7 

dd ? 
ends 



4t 



struc 
dd ? 



4t 



exit_point 
incorrect vie codes 



dd 
7 

dd 



dd 



;;; Buffer bit pointer (31-0) 
;;; Pointer to data and its size 
? ; ; ; Internal bitsream pointers 
7 

; ; ; Input or output file 

? ; ; ; Exit point to handle 
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MplBitStream ends 



TEXT 



segment 



extrn 



_longjmp : near 



;;; unsigned long asmbsGetVLC (MplBitStream *bsm, const 
VLCDecodeTable *vlcTable) 

_asmbsGetVLC proc near 
sizeof_locals equ 14h 
ws equ esp + 04h 

bsm equ dword ptr [eax -h 04h] 
table equ dword ptr [eax + 08h] 

mov eax, esp 

sub esp, sizeof_locals 

and esp, Of f f f f f f Oh 

push eax 

mov [ws],esi 

mov [ws + 04h],edi 

mov [ws + 08h] , ecx 

mov [ws + Och] , ebx 

mov [ws -f 10h],ebp 

mov esi,bsm 

mov edi, table 

sub ebp,ebp ; 



ebp ~ val 



do_while_loop : 



mov 
mov 
mov 

mov 
mov 
sub 
js 

positive 
mov 
inc 
shr 
and 

decode ; 

lea 
mov 
mov 
sub 
sub 



ebx, MplBitStream. current_data [esi] 
eax, [ebx] 

edx, [ebx + 4] ;;; eax:edx = bitstream data 

ebx, [edi + ebp * 4] 

ecx, MplBitStream. bit_ptr [esi] 
ecx, ebx 

negative_ptr ;;; not taJcen 

ptr : 

MplBitStream. bit_ptr [esi] , ecx 

ecx 

eax, cl 

eax,bit_mask[ebx * 4] ;;; eax = data 



eax, [eax * 2 + ebp + 1] ;;; eax = pos 
ebp, [edi + eax * 4 + 4] ;;; ebp = val 
ecx, ebx 

ecx, [edi + eax * 4] ;;; ecx = unget bits 
ebx, ecx 
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taken 



jz do_while_loop 



if code len == 0 



cmp ebp, 7defh 

jz error^handler 

mov eax^ebp 



; ; ; not taken 



mov ebx, MplBitStream.bit_ptr [esi] 



add 


ebx^ ecx 




test 


ebx^ 60h 




jnz 


unget_more 


almost exit: 




mov 


MplBitStream.bit ptr[esi],ebx 


exit : 






mov 


esi^ [ws] 




mov 


edi, [ws + 


04h] 


mov 


ecx, [ws + 


08h] 


mov 


ebx, [ws + 


Och] 


mov 


ebp, [ws + 


lOh] 


mov 


esp, [esp] 




ret 






negative_ptr : 




add 


ecx, 20h 




mov 


MplBitStream.bit_ptr [esi] , ecx 


add 


MplBitStream. current data [esi! 


lea 


ecx, [ecx + 


ebx - 3fh] 


neg 


ecx 


; ; ; ecx = 31 - 


shld 


eax, edx, cl 




mov 


ecx, 20h 




sub 


ecx, ebx 




shr 


eax, cl 


f f f eax — 


jmp 


decode 


; ; ; taken 



(bitptr' + nbit) 



unget_more : 

sub ebx, 2 Oh 

sub MplBitStream. current_data [esi] ,0411 
jmp almost_exit 

error_handler : 
push -1 

lea edx, MplBitStream. exit_point [esi] 

push edx 

call _longjmp 

; ; ; no return here 

int OOh 

_asmbsGetVLC endp 

_TEXT ends 

_DATA segment 
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bit mask 



DATA 

end 



PCT/RU2003/000339 



dd OOOOOOOOh 

dd OOOOOOOlh, 00000003h, 00000007h, OOOOOOOfh 

dd OOOOOOlfh, 0000003fh, 0000007fh, OOOOOOffh 

dd OOOOOlffh, OOOOOSffh, 000007ffh, OOOOOfffh 

dd OOOOlfffh, 00003fffh, OOOOTfffh, OOOOffffh 

dd OOOlffffh, OOOSffffh, 0007ffffh, OOOfffffh 

dd OOlfffffh, OOSfffffh, 007fffffh, OOffffffh 

dd Olffffffh, OSffffffh, 07ffffffh, Offfffffh 

dd Ifffffffh, Sfffffffh, 7fffffffh, Offffffffh 
ends 
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